IMAGE PROCESSING APPARATUS AND METHOD 



BACKGROUND OF THE INVENTION 

1) Field of the Invention 

5 The present invention relates to a technology for reading a color 

image through a scanner to reproduce the image on a transfer paper in 
two colors of red and black. 

2) Description of the Related Art 

10 Multifunction peripherals that functions as printer, copier, 

facsimile, and scanner are known. Moreover, multifunction peripherals 
that form two-color images are also known. 

Top row in Fig. 14 illustrates a pixel string with pixels A to G 
spaced at intervals of T and bottom row illustrates the same pixel string 

15 when the number of pixels in the pixel string is reduced to 80 %. It is 
common to use the cubic convolution method to perform increase 
and/or reduction of pixels, because, this method is accurate. In this 
method, four consecutive pixels are selected from the pixel string as 
sampling pixels, and a virtual pixel that is a pixel after increase and/or 

20 reduction of pixels is obtained by using a cubic function as a distance 
parameter. 

If the pixels that are at interval T in the pixel string shown in Fig. 
14 are to be reduced to 80%, the interval between two virtual pixels will 
be 100/80 = 1.25T. For example, a virtual pixel a is obtained by using 
25 a cubic function G (x) (not shown) and four pixels A, B, C, and D as 



sampling pixels. 

Fig. 15 illustrates how data is generated in varying processing in 
the apparatus that reproduces an image in two colors. The original 
color data is converted into binary color data, and the original density 
5 data is converted into binary density data. However, if an unbalance is 
generated between the original color data and the binary color data or 
the original density data or the binary density data, the desired image is 
not produced after the varying processing. 

Suppose the cubic function convolution method is used for 

10 varying processing of the density data and simple interpolation, which 
does not take into consideration the phase component, is used for 
varying processing of color data. The density data at a virtual pixel (B) 
between the sampling pixel (A) as black and a sampling pixel as any 
other color each identified by a color identifying unit is calculated using 

15 information for four pixels forward and backward from the virtual pixel B. 
On the other hand, the color data is calculated using information for one 
forward pixel. 

Therefore, a black pixel "a" is generated unlike the original 
image. This represents a shift between the color data and the density 
20 data. 

SUMMARY OF THE INVENTION 

It is an object of the present invention to solve at least the 
problems in the conventional art. 
25 An image processing apparatus according to one aspect of the 
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present invention includes image reading means for reading analog 
color image data of a color image, separates the analog color image 
data into red image data, green image data, and blue image data, and 
converts the red image data into digital red image data, the green 
5 image data into digital green image data, and the blue image data into 
digital blue image data; and processing means for subjecting the digital 
red image data, the digital green image data, and the digital blue image 
data to digital processing. The processing means includes color 
identifying means for determining, for each of the digital red image data, 

10 the digital green image data, and the digital blue image data, whether 
there exists black data, and generates density data from the black data 
when black data exists, and generates color data from data other than 
the black data; multinarizing means for converting the color data for 
each of the digital red image data, the digital green image data, and the 

15 digital blue image data into multinary data; magnification varying means 
for varying the density data and the color data multinarized, using a 
cubic function convolution method; binarizing means for binarizing the 
color data varied, based on a predetermined threshold; and image 
printing means for printing the color data binarized and the density data 

20 varied, onto a recording medium. 

An image processing apparatus according to another aspect of 
the present invention includes an image reader that reads analog color 
image data of a color image, separates the analog color image data into 
red image data, green image data, and blue image data, and converts 

25 the red image data into digital red image data, the green image data 



into digital green image data, and the blue image data into digital blue 
image data; an image processor that subjects the digital red image data, 
the digital green image data, and the digital blue image data to digital 
processing. The image processor includes a separating unit that 
5 determines, for each of the digital red image data, the digital green 
image data, and the digital blue image data, whether there exists black 
data, and generates density data from the black data when black data 
exists, and generates color data from data other than the black data; 
and a two-color image processing unit that includes a multinarizing unit 

10 that converts the color data for each of the digital red image data, the 
digital green image data, and the digital blue image data into multinary 
data; a magnification varying unit that varies the density data and the 
color data multinarized, using a cubic function convolution method; and 
a binarizing unit that binarizes the color data varied, based on a 

15 predetermined threshold. An image forming unit that prints the color 
data binarized and the density data varied, onto a recording medium. 

An image processing method according to still another aspect of 
the present invention includes reading analog color image data of a 
color image, separates the analog color image data into red image data, 

20 green image data, and blue image data and converting the red image 
data into digital red image data, the green image data into digital green 
image data, and the blue image data into digital blue image data; 
determining, for each of the digital red image data, the digital green 
image data, and the digital blue image data, whether there exists black 

25 data, and generating density data from the black data when black data 



exists, and generating color data from data other than the black data; 
converting the color data for each of the digital red image data, the 
digital green image data, and the digital blue image data into multinary 
data; varying the density data and the color data multinarized, using a 
5 cubic function convolution method; binarizing the color data varied, 
based on a predetermined threshold; and printing the color data 
binarized and the density data varied, onto a recording medium. 

The other objects, features and advantages of the present 
invention are specifically set forth in or will become apparent from the 
10 following detailed descriptions of the invention when read in conjunction 
with the accompanying drawings. 



BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram of a whole configuration of a 
15 multifunction peripheral or an image processing apparatus according to 

one embodiment of the present invention; 

Fig. 2 is a block diagram illustrating a sequence of converting 

image data for three colors of red (R), green (G), and blue (B) into 

image data for black and any color other than black; 
20 Fig. 3 is a block diagram illustrating a configuration for 

performing the processing shown in Fig. 2; 

Fig. 4 illustrates how to determine whether the image data is red 

or not; 

Fig. 5 illustrates how to determine whether the image data is 
25 black or white; 



Fig. 6 is a matrix used for correction to color shift; 

Fig. 7 illustrates linear patterns created based on the matrix of 

Fig. 6; 

Fig. 8 is a block diagram of the image processing apparatus; 
5 Fig. 9 is a detailed illustration of a VDC and an image forming 

unit; 

Fig. 10 is a block diagram illustrating varying processing of color 
data and density data; 

Fig. 11 illustrates the processing performed in a multinarizing 

10 unit; 

Fig. 12 illustrates the processing performed in a binarizing unit; 
Fig. 13 illustrates the varying processing of color data and 
density data; 

Fig. 14 is an illustration of virtual pixels and positions thereof 
15 when a pixel string aligned at intervals of T is reduced to 80 %; and 
Fig. 15 illustrates the varying processing of a device that 
reproduces an image in two colors. 



DETAILED DESCRIPTION 
20 Exemplary embodiments of the present invention will be 

explained below with reference to the accompanying drawings. 

Fig. 1 is a block diagram of a whole configuration of an image 

processing apparatus according to one embodiment of the present 

invention. Fig. 8 is a block diagram of a key configuration of the image 
25 processing apparatus and illustrates a configuration of a multifunction 

6 



peripheral (MFP) capable of two-color copying (e.g., red and black) on 
up to a A2-size sheet of paper. It is noted that the multifunction 
peripheral is exemplified in the embodiment of the present invention, 
but the present invention is applicable to image forming apparatuses 
5 such as copiers, printers, and facsimiles. 

A reading unit that optically reads a document focuses light 
reflected by lamp from the document on a light receiving element 
through a mirror and a lens. The light receiving element (as a 
charge-coupled device (CCD) in the embodiment) is mounted on a 

10 sensor board unit (SBU). The CCD is a three linear CCD image sensor 
that converts image formation for the document into electrical signals 
corresponding to respective colors through red (R), green (G), and blue 
(B) filters. An A/D converter converts the signals output from the CCD 
image sensor into digital image data, and the SBU outputs image 

15 signals for the data together with synchronization signals. 

The image signals output from the SBU are input into a unit (an 
image data controller or a color data interface controller, hereinafter, 
referred to as CDIC) that integrally controls digital signal-bus interface, 
and shares the processing for the digital signals. The CDIC controls 

20 the whole transmission of image data between functional devices and a 
data bus. The CDIC performs data transfer among the SBU, a parallel 
bus, and a programmable arithmetic processing unit (an image 
processor or image processing peripheral, hereinafter, referred to as 
IPP) that subjects the digitized image signals to image processing. 

25 The CDIC also performs communications between a system controller 



that controls the whole system of the embodiment and a process 
controller for the image data. 

As for the digital image data for A-to-D converted R, G, and B, 
non-uniformity (signal degradation in a scanner system) of the data due 
5 to an optical system is corrected in the SBU in this embodiment. The 
digital image data for R, G, and B of which non-uniformity has been 
corrected is input into an RGB line synchronization shift correcting unit 
of a unit (a memory module, hereinafter, referred to as MEM) that 
integrally controls the SBU, CDIC, or access of digital signals to 

10 memory. The unit corrects a synchronization shift between the image 
data for colors. In this embodiment, since scanning is carried out by 
the CCD with three lines, synchronization shifts among 12 lines are 
produced in the colors. The SBU or CDIC in this embodiment 
generates a multinary luminance signal for a target pixel and a color 

15 determination signal indicating whether the target pixel is red based on 
the R, G, and B digital image data. 

Fig. 3 is a block diagram illustrating a configuration for 
performing the processing such that three-color image data for R, G, 
and B is converted to image data for black and any color other than 

20 black. A black and specific color separating unit 302 includes a 

register 311, a correction value selector 312, an input selector 303, a 
color detector 304, a color determining unit 305, a matrix generating 
unit 306, a pattern matching unit 307, a color shift correcting unit 308, a 
luminance calculating unit 309, and a timing adjusting unit 310. 

25 The register 311 previously stores a correction value 1 and a 



correction value 2 used for detecting red in the black and specific color 
separating unit 302, a threshold value of green, a threshold value of 
luminance for determining white or black, and information for process 
modes (mode for forming a two-color image of black and red, or mode 
5 for forming a two-color image of black and blue). The correction value 
selector 312 selects any of values stored in the register 311 according 
to a process mode or a level, and inputs the value to the color detector 
304. 

The input selector 303 selects two image data required for 

10 processing from the image data for R, G, and B based on the data for 
mode stored in the register 311. The color detector 304 detects red 
from the selected two image data. In the image processing apparatus 
of the embodiment, processing for color detection 201 shown in Fig. 2 
is executed in the input selector 303 and the color detector 304. 

15 The processing for color detection 201 when red is to be 

detected will be explained below. The input selector 303 selects image 
data for R and image data for G from the R, G, and B image data, and 
inputs the selected image data to the color detector 304. The 
correction value selector 312 selects the correction value 1 for red and 

20 the correction value 2 for red each of which is used for detecting red, 
and the threshold value of green, and outputs the selected values to the 
color detector 304. The color detector 304 substitutes the input R and 
G image data in expression (1) through expression (3) explained below, 
and determines if the input image data is red according to whether the 

25 conditions of the expressions (1) to (3) are satisfied. 



G > KG 



... (1) 



R > G + KR1 



... (2) 



R > G + KR2 



... (3) 



where R is image data (light quantity signal) for red, G is image data 
5 (light quantity signal) for green, KG is a threshold value of green, KR1 
is a correction value 1 of red, and KR2 is a correction value 2 of red. It 
is noted that a relation between the conditions of the expressions (1) to 
(3) and results of determination is as shown in Fig. 4. 



10 image processing apparatus, the color detector 304 determines whether 
the image data is black or white (see a box labeled determination on 
white or black 202 in Fig. 2) based on determination expressions shown 
in Fig. 5. 



15 image data and calculates each luminance value of the image data. 
The results of the calculation are input into the color determining unit 
305 and the timing adjusting unit 310. The timing adjusting unit 310 
outputs luminance data at a timing at which the color shift correcting 
unit explained later outputs two-color data. 

20 The color determining unit 305 reads the threshold value of the 

luminance from the register 311, compares the value with the calculated 
results in the luminance calculating unit 309, and determines whether 
each pixel is red, black, or white. The color determining unit 305 then 
outputs the results of determination to the matrix generating unit 306 as 

25 signals indicating red, black, and white. The matrix generating unit 306 



If the mode for forming a white or black image is set in the 



The luminance calculating unit 309 receives the R, G, and B 
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receives the signals, stores the signals for five lines, and forms a 5 x 5 
matrix as shown in Fig. 6. Each of values 11, 12, 13 • • ■ forming the 
matrix corresponds to one pixel. 

The matrix generating unit 306 determines a pixel 33 in the 5 x 
5 5 matrix as a target pixel, and forms a linear line consisting of four 

pixels including the pixel 33 as the third pixel. By obtaining linear lines 
in vertical, horizontal, and slanting directions, eight types of linear line 
patterns (from LP1 to LP8) in total are formed. Fig. 7 illustrates the 
eight linear line patterns. 

10 The pattern matching unit 307 receives the patterns from LP1 to 

LP8, and compares the LP1 to LP8 with the preset reference pattern. 
The pattern matching unit 307 then determines whether each of the 
patterns from LP1 to LP8 matches the reference pattern, and outputs 
results of determination to the color shift correcting unit 308. 

15 The color shift correcting unit 308 is the unit performs the color 

shift correction 203 (see Fig. 2). If each of the patterns from LP1 to 
LP8 matches the reference pattern, the color shift correcting unit 308 
determines that the target pixel included in a linear line pattern 
matching the reference pattern is color-shifted, and changes the color 

20 of the target pixel (e.g., red to black, black to red) according to a preset 
procedure. The image data of which color shift has been corrected is 
output from the color shift correcting unit 308 as two-color data forming 
two-color image of black and red. 

Subsequently, the IPP separates the red digital image signal 

25 from the black digital image signal, subjects the signals to 



predetermined image processing, and stores them in the MEM through 
the CDIC. A flow of the image data is explained below. The flow is 
shown in a case where the image data is stored in memory, and 
additional processing such as rotation of the data in an image 
5 orientation or image synthesis required when the image is to be read. 
The data transferred from the IPP to the CDIC is sent from the CDIC to 
an image memory access controller (IMAC) through a parallel bus. 
The IMAC performs access controls of the image data to the MEM, 
expands data for printing of an external PC (information processing 

10 terminal), and compresses and decompresses the image data for 

making effective used of the memory under the control of the system 
controller. The data transferred to the IMAC is compressed, stored in 
the MEM, and the stored data is read as required. The read data is 
decompressed to be restored to the original image data, and this data is 

15 returned from the IMAC to the CDIC through the parallel bus. The data 
transferred from the CDIC to the IPP is subjected to image quality 
processing and is pulse-controlled in a video data controller (VDC), and 
an image forming unit forms a reproduced image on a transfer paper. 
Fig. 9 is a detailed diagram of the VDC and the image forming 

20 unit 924. The image forming unit includes a photoreceptor 903 around 
which a charger 908 as a charging unit, a first exposing device 909 as a 
deflective scanning type exposing unit, a developing device 910 as a 
first developing unit that uses black toner, a second exposing device 
911 as a linear type exposing unit, a developing device 912 as a second 

25 developing unit that uses red toner, a transfer charger 913, and a 



cleaning device 914 are sequentially arranged. That is, the first 
exposing device 909 and the second exposing device 911 are disposed 
on discrete positions around the periphery of the photoreceptor 903 so 
as to form latent images. Timing is adjusted so that the image data for 
5 red color, of the image data for black and red colors, is output to the 
second exposing device 911 at a timing slightly delayed from the image 
data for black color. 

The first exposing device 909 forms an electrostatic latent image 
formed on the photoreceptor 903 that is uniformly charged by the 

10 charger 908, and the first developing device 910 develops the latent 
image with black toner. The second exposing device 911 forms an 
electrostatic latent image on the photoreceptor 903 and the second 
developing device 912 develops the latent image with red toner. Paper 
feed rollers 916 feed a transfer paper 917 from a paper feed tray 915, 

15 and registration rollers 918 once stop the paper 917 and feed it to a 
transfer portion including the transfer charger 913 at a timing at which 
the paper is registered with a front edge of a toner image. A transfer 
belt 919 transfers the paper 917 from the transfer portion to a fixing 
device 920. The paper 917 is subjected to fixing processing, and is 

20 ejected or transferred to be fed again. In such a manner, a 2-color 
image of black and red is formed. 

In the flow of the image data in Fig. 1 , the functions of the 
multifunction peripheral can be achieved through the parallel bus and 
the bus controlled by the CDIC. 

25 A facsimile transmission function is performed by subjecting 



read image data to image processing in the IPP and transferring the 
image data to a facsimile control unit (FCU) through the CDIC and the 
parallel bus. The FCU converts the data to data for a communication 
network and transmits the data to a public network (PN) as facsimile 
5 data. 

Through facsimile reception, line data from the PN is converted 
to image data at the FCU, and transferred to the IPP through the 
parallel bus and the CDIC. In this case, the image data is not 
subjected to any particular image processing, but dots are re-arranged 

10 and pulses are controlled at the VDC to form a reproduced image on a 
transfer paper in the image forming unit. 

The system controller and the process controller perform control 
for allocation of the reading unit, the image forming unit, and using right 
of parallel bus to jobs under the situations in which a plurality of jobs, 

15 for example, a copying function, a facsimile transmission/reception 
function, and a printer output function operate in parallel with each 
other. The process controller controls the flow of the image data, and 
the system controller controls the whole system and manages startup of 
each resource. Any of the functions of the multifunction peripheral is 

20 selected through an operation panel (Ope. Pane) to set contents of 

processing for a copying function, a facsimile function, or the like. The 
system controller and the process controller mutually perform 
communications through the parallel bus, the CDIC, and a serial bus. 
The CDIC converts data format for data interface between the parallel 

25 bus and the serial bus. The light receiving element in the embodiment 



is the three linear image sensor of R, G, and B, but two linear image 
sensor of R and G may be used in an apparatus for reproduction of the 
data in two colors of red and black. 

Fig. 10 is a block diagram illustrating a varying processing of 
5 color data and density data. A two-color image processing unit 803 in 
the image processor as shown in Fig. 8 performs the varying processing 
on color data and density data. The two-color image processing unit 
803 includes a multinarizing unit, a magnification varying unit, and a 
binarizing unit. The density data is varied in the magnification varying 

10 unit, and the color data is converted to multinary data in the 

multinarizing unit, and is binarized in the binarizing unit based on 
predetermined threshold values. 

Fig. 11 illustrates the multinarizing unit for color data. If the 
input color data is 0, the multinarizing unit outputs 0, and outputs 255 if 

15 it is 1. 

Fig. 12 illustrates the binarizing unit for color data. If the input 
color data is 0, the binarizing unit outputs 0, and outputs 1 if it is not 0. 

Fig. 13 illustrates the varying processing of color data and 
density data. If the density data is varied using the cubic function 

20 convolution method, a virtual pixel (a) is affected by a sampling pixel B 
identified as any color other than black. More specifically, the pixel (a) 
is between a sampling pixel A as black and the sampling pixel B 
identified in the black and specific color separating unit 302. If the 
color data for the virtual pixel is black, a black pixel is formed, and this 

25 black pixel does not exist in the original image. Therefore, the color 



data for the virtual pixel needs to be changed to a color other than black. 
The color data is converted to multinary data in the multinarizing unit, 
and is varied by the cubic function convolution method. 

The color data for a virtual pixel is 0 if the virtual pixel exists 
5 between a sampling pixel as black and a sampling pixel as black each 
identified in the black and specific color separating unit 302. The color 
data for a virtual pixel is 255 if the virtual pixel exists between a 
sampling pixel as a color other than black and a sampling pixel as a 
color other than black each identified in the color identifying unit. The 

10 color data for a virtual pixel is a value greater than 0 regardless of 

parameters if the virtual pixel exists between a sampling pixel as black 
and a sampling pixel as a color other than black each identified in the 
color identifying unit. By setting the threshold value of the binarizing 
unit to 0, if the color data is greater than 0, then the color is any color 

15 other than black, and if it is 0, then the color is black. Therefore, 
displacement does not occur between the color data and the density 
data. 

The data is sequentially processed in the multinarizing unit, the 
magnification varying unit, and the binarizing unit. Therefore, in the 
20 image processing apparatus that converts the color image into 

two-color image of a specific color and black, displacement due to a 
virtual pixel does not occur between the color data and the density 
data. 

The present document incorporates by reference the entire 
25 contents of Japanese priority document, 2002-267435 filed in Japan on 



September 12, 2002. 

Although the invention has been described with respect to a 
specific embodiment for a complete and clear disclosure, the appended 
claims are not to be thus limited but are to be construed as embodying 
5 all modifications and alternative constructions that may occur to one 
skilled in the art which fairly fall within the basic teaching herein set 
forth. 
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